Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Multimodal knowledge graph representation learning: a review
Chunlei WANG, Xiao WANG, Kai LIU
Journal of Computer Applications    2024, 44 (1): 1-15.   DOI: 10.11772/j.issn.1001-9081.2023050583
Abstract862)   HTML69)    PDF (3449KB)(821)       Save

By comprehensively comparing the models of traditional knowledge graph representation learning, including the advantages and disadvantages and the applicable tasks, the analysis shows that the traditional single-modal knowledge graph cannot represent knowledge well. Therefore, how to use multimodal data such as text, image, video, and audio for knowledge graph representation learning has become an important research direction. At the same time, the commonly used multimodal knowledge graph datasets were analyzed in detail to provide data support for relevant researchers. On this basis, the knowledge graph representation learning models under multimodal fusion of text, image, video, and audio were further discussed, and various models were summarized and compared. Finally, the effect of multimodal knowledge graph representation on enhancing classical applications, including knowledge graph completion, question answering system, multimodal generation and recommendation system in practical applications was summarized, and the future research work was prospected.

Table and Figures | Reference | Related Articles | Metrics
Multi-contour segmentation algorithm for point cloud slices of irregular objects
Jin ZHANG, Wen XU, Yuqiao ZHOU, Kai LIU
Journal of Computer Applications    2023, 43 (10): 3209-3216.   DOI: 10.11772/j.issn.1001-9081.2022101536
Abstract148)   HTML6)    PDF (4343KB)(60)       Save

When using the slicing method to measure the point cloud volumes of irregular objects, the existing Polygon Splitting and Recombination (PSR) algorithm cannot split the nearer contours correctly, resulting in low calculation precision. Aiming at this problem, a multi-contour segmentation algorithm — Improved Nearest Point Search (INPS) algorithm was proposed. Firstly, the segmentation of multiple contours was performed through the single-use principle of local points. Then, Point Inclusion in Polygon (PIP) algorithm was adopted to judge the inclusion relationship of contours, thereby determining positive or negative property of the contour area. Finally, the slice area was multiplied by the thickness and the results were accumulated to obtain the volume of irregular object point cloud. Experimental results show that on two public point cloud datasets and one point cloud dataset of chemical electron density isosurface, the proposed algorithm can achieve high-accuracy boundary segmentation and has certain universality. The average relative error of volume measurement of the proposed algorithm is 0.043 6%, which is lower than 0.062 7% of PSR algorithm, verifying that the proposed algorithm achieves high accuracy boundary segmentation.

Table and Figures | Reference | Related Articles | Metrics
Convolutional network-based vehicle re-identification combining wavelet features and attention mechanism
Guangkai LIAO, Zheng ZHANG, Zhiguo SONG
Journal of Computer Applications    2022, 42 (6): 1876-1883.   DOI: 10.11772/j.issn.1001-9081.2021040545
Abstract304)   HTML12)    PDF (2250KB)(98)       Save

Aiming at the problem of insufficient representation ability of features extracted by the existing vehicle re-identification methods based on convolution Neural Network (CNN), a vehicle re-identification method based on the combination of wavelet features and attention mechanism was proposed. Firstly, the single-layer wavelet module was embedded in the convolution module to replace the pooling layer for subsampling, thereby reducing the loss of fine-grained features. Secondly, a new local attention module named Feature Extraction Module (FEM) was put forward by combining Channel Attention (CA) mechanism and Pixel Attention (PA) mechanism, which was embedded into CNN to weight and strengthen the key information. Comparison experiments with the benchmark residual convolutional network ResNet-50 and ResNet-101 were conducted on VeRi dataset. Experimental results show that increasing the number of wavelet decomposition layers in ResNet-50 can improve mean Average Precision (mAP). In the ablation experiment, although ResNet-50+Discrete Wavelet Transform (DWT) has the mAP reduced by 0.25 percentage points compared with ResNet-101, it has the number of parameters and computational complexity lower than those of ResNet-101, and has the mAP, Rank-1 and Rank-5 higher than those of ResNet-50 without DWT, verifying that the proposed model can effectively improve the accuracy of vehicle retrieval in vehicle re-identification.

Table and Figures | Reference | Related Articles | Metrics
Federated learning survey:concepts, technologies, applications and challenges
Tiankai LIANG, Bi ZENG, Guang CHEN
Journal of Computer Applications    2022, 42 (12): 3651-3662.   DOI: 10.11772/j.issn.1001-9081.2021101821
Abstract2625)   HTML162)    PDF (2464KB)(1829)       Save

Under the background of emphasizing data right confirmation and privacy protection, federated learning, as a new machine learning paradigm, can solve the problem of data island and privacy protection without exposing the data of all participants. Since the modeling methods based on federated learning have become mainstream and achieved good effects at present, it is significant to summarize and analyze the concepts, technologies, applications and challenges of federated learning. Firstly, the development process of machine learning and the inevitability of the appearance of federated learning were elaborated, and the definition and classification of federated learning were given. Secondly, three federated learning methods (including horizontal federated learning, vertical federated learning and federated transfer learning) which were recognized by the industry currently were introduced and analyzed. Thirdly, concerning the privacy protection issue of federated learning, the existing common privacy protection technologies were generalized and summarized. In addition, the recent mainstream open-source frameworks were introduced and compared, and the application scenarios of federated learning were given at the same time. Finally, the challenges and future research directions of federated learning were prospected.

Table and Figures | Reference | Related Articles | Metrics
Structure-fuzzy multi-class support vector machine algorithm based on pinball loss
Kai LI, Jie LI
Journal of Computer Applications    2021, 41 (11): 3104-3112.   DOI: 10.11772/j.issn.1001-9081.2021010062
Abstract600)   HTML40)    PDF (816KB)(219)       Save

The Multi-Class Support Vector Machine (MSVM) has the defects such as strong sensitivity to noise, instability to resampling data and lower generalization performance. In order to solve the problems, the pinball loss function, sample fuzzy membership degree and sample structural information were introduced into the Simplified Multi-Class Support Vector Machine (SimMSVM) algorithm, and a structure-fuzzy multi-class support vector machine algorithm based on pinball loss, namely Pin-SFSimMSVM, was proposed. Experimental results on synthetic datasets, UCI datasets and UCI datasets adding different proportions of noise show that, the accuracy of the proposed Pin-SFSimMSVM algorithm is increased by 0~5.25 percentage points compared with that of SimMSVM algorithm. The results also show that the proposed algorithm not only has the advantages of avoiding indivisible areas of multi-class data and fast calculation speed, but also has good insensitivity to noise and stability to resampling data. At the same time, the proposed algorithm considers the fact that different data samples play different roles in classification and the important prior knowledge contained in the data, so that the classifier training is more accurate.

Table and Figures | Reference | Related Articles | Metrics
Noise reduction of optimization weight based on energy of wavelet sub-band coefficients
WANG Kai LIU Jiajia YUAN Jianying JIANG Xiaoliang XIONG Ying LI Bailin
Journal of Computer Applications    2013, 33 (08): 2341-2345.  
Abstract764)      PDF (751KB)(332)       Save
Concerning the key problems of selecting threshold function in wavelet threshold denoising, in order to address the discontinuity of conventional threshold function and large deviation existing in the estimated wavelet coefficients, a continuous adaptive threshold function in the whole wavelet domain was proposed. It fully considered the characteristics of different sub-band coefficients in different scales, and set the energy of sub-band coefficients in different scales as threshold function's initial weights. Optimal weights were iteratively solved by using interval advanced-retreat method and golden section method, so as to adaptively improve approximation level between estimated and decomposed wavelet coefficients. The experimental results show that the proposed method can both efficiently reduce noise and simultaneously preserve the edges and details of image, also achieve higher Peak Signal-to-Noise Ratio (PSNR) under different noise standard deviations.
Related Articles | Metrics
Multi-focus image fusion based on non-separable symmetric wavelets
LI Kai LIU Bin
Journal of Computer Applications    2012, 32 (05): 1283-1285.  
Abstract1316)      PDF (2291KB)(772)       Save
A new fusion method of multi-focus images based on the four-channel non-separable wavelet was proposed, which aimed to solve the problem which exists in the separable wavelet-based fusion methods. First, a 4×4 non-separable wavelet 4-channel filter bank with linear phase using the theory of non-separable wavelets was constructed. Then images involving the fusion were decomposed by using the filter bank, for low-frequency part, the average value was selected, for the three high-frequency parts of each level, the value of the area window whose energy was bigger was selected. Finally, the new fused image was reconstructed. The performance of the method was evaluated using entropy, average gradient, etc. The experimental results show that it has good effect on the fusion of multi-focus images. The performance is better than that of the separable wavelet fusion method by using the same fusion algorithm. According to this method, the fused images are clearer and the detailed edge information of low-frequency domain is better obtained.
Reference | Related Articles | Metrics
Attribute mapping search algorithm based on combined similarity calculation in data integration
ZHENG Kai LIANG Zhuo-ming ZHENG Wen-dong
Journal of Computer Applications    2011, 31 (03): 683-685.   DOI: 10.3724/SP.J.1087.2011.00683
Abstract1088)      PDF (630KB)(891)       Save
In view of the problem of attribute mapping techniques in materialized data integration, the authors proposed a search algorithm of attribute mapping based on combined similarity calculation (SACS). The proposed algorithm was established through intuitive calculation factors and combined formula to traverses attribute mapping in data sources. The algorithm avoids the sample selection problem of machine learning in traditional attribute mapping techniques, and improves the precision rate and recall rate for attribute mapping.
Related Articles | Metrics